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ABSTRACT 

The  Lorenz  system  is  used  to  discuss  two  kinds  of  predictability:  the  model  sensitivity  to  inaccurate  initial 
conditions  (first  kind)  and  to  inaccurate  boundary  conditions  (second  kind).  The  first  kind  of  predictability  has 
been  investigated  for  a  long  time,  but  not  the  second  kind.  It  was  found  that  the  Lorenz  system  has  a  capability 
to  detect  both  kinds  of  predictability  since  the  boundary  condition  is  represented  by  a  model  parameter,  r.  Two 
sensitivity  runs  are  designed  by  perturbing  the  initial  condition  and  the  model  parameter  r  by  the  same  small 
relative  error  (10~4),  which  is  equivalent  to  10%  of  the  instrumentational  accuracy  for  surface  temperature 
measurement.  Comparison  of  model  output  between  the  control  run  and  the  sensitivity  runs  shows  that  the  model 
error  growth  and  the  growing  period  are  comparable  between  the  two  kinds  of  predictability.  This  indicates  the 
importance  of  preparing  accurate  boundary  conditions  in  numerical  prediction. 


1.  Introduction 

Atmospheric  and  oceanic  numerical  models  are  usu¬ 
ally  initial-value  and/or  boundary-value  problems. 
Change  in  either  initial  or  boundary  condition  leads  to 
a  variation  of  model  solutions.  Much  of  the  predict¬ 
ability  research  has  been  done  on  the  response  of  model 
behavior  to  an  initial  value  perturbation.  Little  effort 
has  been  made  to  study  the  response  of  model  behavior 
to  a  boundary  value  perturbation. 

Recently,  Chu  et  al.  (1998)  found  a  large  response 
of  the  National  Center  for  Atmospheric  Research 
(NCAR)  Community  Climate  Model  version  3  (CCM3) 
to  a  tiny  Gaussian-type  random  sea  surface  temperature 
(SST)  error.  The  model  they  used  contains  18  levels 
in  the  vertical  with  a  top  at  2.917  mb  and  uses  spherical 
harmonics  as  horizontal  basis  functions  with  a  trianu- 
gular  truncation  at  wavenumber  21  (approximately  a 
5.6°  X  5.6°  transform  grid).  The  CCM3  was  integrated 
from  the  1  September  climatology  of  the  atmospheric 
and  surface  fields,  which  was  provided  by  the  NCAR 
Climate  and  Global  Dynamics  (CGD)  Division.  The 
surface  boundary  conditions  were  monthly  sea  and 
land  surface  temperatures  (also  obtained  from  NCAR 
CGD  Division)  linearly  interpolated  onto  each  time 
step  (20  min).  First,  they  integrated  CCM3  for  16 
months  from  1  September  to  31  December  of  the  next 


Corresponding  author  address:  Prof.  Peter  C.  Chu,  Department  of 
Oceanography,  Naval  Postgraduate  School,  Code  OC/CU,  Monterey, 
CA  93943-5000. 

E-mail:  chu@nps.navy.mil 


year  (control  run)  and  used  the  data  between  1  January 
and  31  December  of  the  second  year  for  comparison. 
Second,  they  did  an  anomaly  run.  Three  months  into 
the  control  run,  they  added  a  tiny  Gaussian-type  ran¬ 
dom  SST  anomaly  with  zero  mean  and  0.05°C  standard 
deviation  generated  by  the  FORTRAN  random  number 
generator  to  monthly  SST  data  (first-year  December  to 
second-year  December),  then  interpolated  into  each 
time  step.  The  rest  of  the  forcing  was  kept  the  same. 
The  model  was  integrated  from  1  December  of  the  first 
year  to  31  December  of  the  second  year.  Third,  they 
calculated  the  root-mean-square  difference  between  the 
anomaly  and  the  control  runs  over  the  global  atmo¬ 
sphere  and,  surprisingly,  found  strong  model  respons¬ 
es,  even  in  the  monthly  mean  values.  The  global  errors 
grow  rapidly  within  the  first  20  days:  0.028  N  m~2  in 
the  surface  wind  stress,  70  W  m~2  in  the  net  surface 
heat  flux,  and  5.7  mm  day-1  in  the  net  moisture  flux. 

Is  this  phenomenon  (predictability  regarding  bound¬ 
ary  condition  error)  universal?  What  is  the  basic  physics 
involved?  Does  it  deserve  recognition  as  a  second  kind 
predictability  problem?  We  will  answer  these  questions 
in  this  note. 

2.  Two-dimensional  system 

We  use  the  Cartesian  coordinate  system  with  x,  y  as 
the  horizontal  coordinates  and  z,  the  vertical  coordinate. 
The  corresponding  velocity  components  are  u,  v,  and 
w.  The  temperature  is  represented  by  T.  Let  us  take  a 
two-dimensional  (i.e.,  v  =  0,  d/dy  =  0)  convection 
problem  depicted  by  Saltzman  (1962)  as  an  example 
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to  understand  the  physics  of  the  boundary  error  prop¬ 
agation. 

Consider  a  fluid  to  be  of  height  H,  with  free  upper 
and  lower  boundaries,  between  which  a  temperature 
contrast,  A T  =  '/TO)  —  T(H),  is  maintained  externally. 
By  virtue  of  the  continuity  equation  a  streamfunction, 
<//,  can  be  defined  as  follows: 


u  = 


d(/f 
dz  ’ 


w 


dlf) 

dx 


(1) 


The  two-dimensional  convection  model  consists  of  a 
horizontal  vorticity  equation. 


d 

dt 


V2i/j 


dji/j,  V2> ft) 
d(x,  z) 


+  vX4i/j  +  ga 


dT 

dx’ 


(2) 


and  a  heat  equation, 
dT  _ 
dt  ~ 

where 


djifj.  T ) 

d(x,  z) 


+  kV27) 


V2  = 


d2  d2 

-  +  - , 

dx2  dz2 


8 )  =  dJiA 

d(x,  z)  dx  dz 


(3) 


dAdJL 

dx  dz  ’ 


and  the  constants  g,  a,  v,  and  k  denote,  respectively, 
the  acceleration  of  gravity,  the  coefficient  of  thermal 
expansion,  the  kinematic  viscosity,  and  the  thermal  con¬ 
ductivity.  Such  a  system  has  lower  boundary  conditions 


replace  T;  the  horizontal  vorticity  and  heat  equations 
(2)  and  (3)  become 


W,  V¥)  + 

d(x,  Z) 


pV4(/f  +  ga 


30 

dx’ 


(8) 


dO 

dt 


W,  0) 

d(x,  z) 


ATdi It 

+ - -  +  kV20. 

H  dx 


(9) 


The  upper  and  lower  boundary  conditions  for  8  are  ho¬ 
mogeneous: 

0(x,  0,  t)  =  0(x,  H,  t )  =  0.  (10) 


We  notice  that  the  boundary  condition  error  [(6)]  be¬ 
comes  an  error  in  the  forcing  term,  ( A77//)(3i///5x ),  in 

(9). 


b.  Lorenz  system 

Lorenz  (1963)  expanded  the  two  dependent  variables 
i/j,  6  in  double  Fourier  series  in  x  and  z,  and  truncated 
the  series  to  include  a  total  of  three  terms: 

a(  1  +  a2)~*K  ’i/r  =  X\/2  sin(7 raH  lx)  sin(7r H~'z), 
irrAT^'d  =  TV 2  cos(7 raH  'x)  sin(7 tH  'z) 

—  Z  sin(2-7T H~1z),  (11) 

where 


T(x,  0,  t)  =  T( 0), 

if/ (x,  0,  f)  =  V2i \>(x,  0,  0  =  0  (4) 

and  upper  boundary  conditions 
T(x,  H,  t)  =  T(H), 

(A(x,  H,  t)  =  V2i//(x,  H,  t)  =  0.  (5) 

Since  T( 0)  and  '/’(/-/ )  are  observable  or  measurable  quan¬ 
tities,  it  is  quite  possible  for  them  to  have  errors.  If  we 
perturb  the  lower  (or  the  upper)  boundary  with  a  small 
error, 

T(x,  0,  t )  =  7T0)  +  eAT,  (6) 

what  is  the  model  response  to  this  boundary  condition 
error?  We  have  two  choices  to  investigate  this  problem: 
(a)  integrating  the  dynamic  system  (2)  and  (3)  with  and 
without  the  boundary  condition  error  separately  and 
comparing  the  difference  and  (b)  transforming  the 
boundary  conditions  into  a  forcing  term.  We  will  take 
the  latter  approach. 


3.  Boundary  errors  transformed  as  forcing  errors 

a.  Variable  transform 
Let  a  new  variable,  0, 


0(x,  z,  t )  =  T(x,  z,  t)  — 


7X0)  -  T(H) 

T (°) - 

ti 


(7) 


r  =  Ra  =  gaHATv'K1, 

Rc  =  774gt2(1  +  a2)3.  (12) 

Here  Ra  is  called  the  Rayleigh  number,  and  R,  is  a 
critical  value.  When  Ra  exceeds  Rc,  convection  will  be 
developed.  The  boundary  error  is  transferred  into  the 
parameter  error  in  r.  Substitution  of  (11)  and  (12)  into 
(8)  and  (9)  leads  to  the  Lorenz  system  (Lorenz  1963): 

dX 

—  =  - oX  +  aY ,  (13) 

dr 


—  =  -XZ  +  rX  -  Y,  (14) 

dr 


—  =  XY  -  bZ.  (15) 

dr 

Here, 

r  =  tt2H2(\  +  a2)hct  (16) 

is  the  dimensionless  time,  while  cr  =  k~1v  is  the  Prandtl 
number,  and  b  =  4(1  +  a2)-1  is  the  wavenumber  pa¬ 
rameter.  The  term  rX  in  Eq.  (14)  comes  from  the  term 
(AT/H)di/j/dx  in  Eq.  (9)  and  thus  a  perturbation  to  the 
boundary  condition  AT  is  equivalent  to  a  perturbation 
to  the  parameter  r.  We  may  call  r  the  boundary-forcing 
parameter. 
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c.  Two  kinds  of  predictability  in  the  Lorenz  system 

Usually  we  use  the  Lorenz  system  [(14)— ( 16)]  to  il¬ 
lustrate  the  predictability  due  to  the  initial  conditions 
X(t0),  T(t0),  and  Z(t0).  We  may  call  it  the  first  kind 
predictability.  The  predictability  due  to  the  boundary 
condition  error  [(6)]  is  now  represented  by  the  parameter 
r  in  the  Lorenz  system.  We  may  call  it  the  second  kind 
predictability.  The  difference  between  the  two  is  ob¬ 
vious.  For  the  first  kind  predictability,  the  error  is  in¬ 
troduced  only  at  the  initial  time  instance  (t  =  r0).  How¬ 
ever,  for  the  second  kind  predictability,  the  error  can  be 
introduced  at  any  time  instance. 

4.  Experiments 

We  integrated  the  Lorenz  system  [( 14)— (16)]  under 
three  different  cases:  the  control  run,  the  sensitivity  to 
initial  condition  run,  and  the  sensitivity  to  boundary 
condition  run.  The  value  At  is  chosen  as  0.01  for  the 
dimensionless  time  increment.  All  three  cases  are  in¬ 
tegrated  from  t  =  0  to  t  =  50. 

a.  Control  run 

We  use  the  same  initial  conditions 
X(C)(0)  =  0,  7<c>(  0)  =  1,  Z<c>(0)  =  0  (17) 

and  the  same  values  for  model  parameters 

8 

r (C)  =  28,  o-(C>  =  10,  6(C)  =  -  (18) 

3 

as  Lorenz  (1963)  for  the  control  run. 

b.  Sensitivity  to  initial  error  run 

We  keep  everything  the  same  as  the  control  run  except 
the  initial  conditions 

X«(0)  =  0,  T(/,(0)  =  T(C,(0)(1  +e), 

Z«(0)  =  0,  (19) 


where  we  introduce  a  small  error  e  in  the  initial  con¬ 
dition.  Here  the  superscript  “7”  denotes  the  sensitivity 
to  the  initial  error  run. 

c.  Sensitivity  to  boundary  error  run 

We  keep  everything  the  same  as  the  control  run  except 
the  parameter  r, 

rm  =  r(c>(1  +  ey  (20) 

where  we  introduce  a  small  error  e  in  the  parameter  r. 
Here  the  superscript  “ZJ”  denotes  the  sensitivity  to  the 
boundary  error  run. 

d.  Selection  of  e 

Here  we  use  the  Lorenz  system  as  a  guide  to  inves¬ 
tigate  the  atmospheric  predictability.  The  accuracy  of 
the  surface  temperature  measurement  is  around  0.1°C. 
If  the  temperature  difference  between  the  lower  and 
upper  boundaries  (AT)  is  assumed  to  be  100°C,  the  rel¬ 
ative  error  in  AT  is  around  1 0  3  under  the  current  lim¬ 
itation  of  instrumentational  accuracy.  We  take  10%  of 
this  value  as  the  small  perturbation,  e  =  10  4 ,  to  the 
initial  condition  and  the  parameter  r. 

e.  Numerical  scheme 

We  use  the  same  numerical  scheme  as  used  by  Lorenz 
(1963),  the  double-approximation  procedure,  to  obtain 
the  numerical  solution.  This  scheme  is  much  more  ac¬ 
curate  than  the  forward  difference  procedure. 

5.  Model  error  growth 

The  model  error  growth  due  to  initial  condition  error, 
boundary  condition  error,  or  both  can  be  obtained  from 
the  time  evolution  of  the  difference  between  the  sen¬ 
sitivity  runs  and  the  control  run.  Thus,  we  use 


{[X<«(t)  -  X<c,(t)]2  +  [yc»(r)  -  T‘c)(t)]2  +  [Z(«(t)  -  Z<c>(t)]2  }1/2 
{ [X(C)(r)]2  +  [T(C)(t)]2  +  [Z(C)(t)]2}1/2 


(21) 


to  detect  the  model  error  growth.  Here  S  =  I,  B. 

The  model  error  evolution  shows  a  similar  pattern  for 
the  two  cases:  a  growing  period  and  an  oscillation  period 
(Figs.  1,  2).  During  the  growing  period,  the  model  error 
E(S)(t)  increases  from  0  at  r  =  0  to  an  evident  value 
[£(S)(r)  >  1]  at  certain  value  of  t,  which  is  called  the 


error-growing  period.  During  the  oscillation  period, 
Ev)(t)  oscillates  between  4.5  and  0.1,  and  Zs(B,(t)  os¬ 
cillates  between  5.0  and  0.2.  We  may  also  notice  that 
the  error-growing  period  and  magnitudes  are  compa¬ 
rable  between  £(/)(t)  and  £(s,(t).  The  dimensionless 
growing  period  is  around  22  for  both  errors. 
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Initial 


Tau 

Fig.  1.  Time  evolution  of  the  initial  error  Em( r). 


6.  Dependence  on  parameter  range 

We  performed  various  numerical  runs  to  show  the 
dependence  of  model  results  on  the  three  parameters: 
r,  cr,  and  b.  For  each  study,  we  vary  only  one  parameter 
and  then  integrate  the  Lorenz  system  [(14)— ( 16)]  for 
three  different  cases:  the  control  run,  the  sensitivity  to 
initial  condition  run,  and  the  sensitivity  to  boundary 
condition  run. 

a.  Boundary  forcing  parameter  r 

Keeping  cr  and  b  fixed  as  in  (18),  the  boundary-forc¬ 
ing  parameter  r  is  varied  from  24  to  30.  A  summary  of 
EIJi(t,  r)  and  E{K](t,  r)  after  the  model  integration  from 
t  =  0  to  t  =  50  is  presented  in  Fig.  3.  The  magnitude 
of  E(B)(t,  r)  is  basically  comparable  to  the  magnitude 
of  Eu,(t,  r)  as  r  varies.  The  maximum  relative  error 
exceeds  7  in  both  cases.  The  dimensionless  growth  pe¬ 
riod  of  Ew(t,  r)  monotonically  increases  with  the  de¬ 
creasing  r  from  20  at  r  =  30  to  50  at  r  ~  24  (Fig.  3a). 
Flowever,  the  dimensionless  growth  period  of  E<K](~,  r) 
has  a  minimum  value  of  20  at  r  =  28  and  increases  as 
r  both  increases  and  decreases.  It  reaches  a  value  of  23 
at  r  =  30  and  a  value  of  50  at  r  ~  24  (Fig.  3b). 

b.  Prandtl  number  cr 

Keeping  r  and  b  fixed  as  in  (18),  the  Prandtl  number 
cr  is  varied  from  5  to  15.  A  summary  of  £(;)(r,  cr) 
and  £(S)(t,  cr)  after  the  model  integration  from  t  = 
0  to  r  =  50  is  presented  in  Fig.  4.  The  magnitude  of 
E{B){t,  cr)  is  basically  comparable  to  the  magnitude 
of  E(I>(t,  cr)  as  cr  varies.  The  maximum  relative  error 
exceeds  7  in  both  cases.  The  dependence  of  dimen¬ 
sionless  growth  period  on  cr  is  quite  similar  between 
the  two  cases.  It  has  a  minimum  value  of  17  at  cr  = 
15  and  increases  with  decreasing  cr  to  a  value  of  50 
as  cr  approaches  5. 


Boundary 


(a)  lnit'al 


S', 


Fig.  3.  Time  evolution  of  relative  error  with  varying  boundary 
forcing  parameter  r:  (a)  EJ'H r,  r)  and  (b)  Em( t,  r). 
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(a)  Initial 


Fig.  4.  Time  evolution  of  relative  error  with  varying  Prandtl  num¬ 
ber  <x:  (a)  a)  and  (b)  E{B\t,  a). 

c.  Wavenumber  parameter  b 

Keeping  r  and  cr  fixed  as  in  (18),  the  wavenumber 
parameter  b  is  varied  from  2  to  4.  A  summary  of 
£«(t,  b)  and  E(B)(t,  b )  after  the  model  integration  from 
t  =  0  to  t  =  50  is  presented  in  Fig.  5.  The  magnitude 
of  E(B)(t,  b )  is  basically  comparable  to  the  magnitude 
of  Eu){t,  b )  as  b  varies.  The  maximum  relative  error 
exceeds  6  in  both  cases.  The  dependence  of  dimen¬ 
sionless  growth  period  on  b  is  quite  similar  between  the 
two  cases. 

7.  Conclusions 

1)  Within  the  nonlinear  dynamics  community,  there 
are  three  types  of  sensitivity  that  are  commonly 
discussed:  sensitivity  to  initial  conditions,  sensitiv¬ 
ity  to  parameters,  and  sensitivity  to  boundary  con¬ 
ditions.  The  first  type  of  sensitivity  has  received  a 
great  deal  of  attention,  the  second  has  received  a 
good  deal  of  attention,  and  the  third  has  received 


relatively  little  attention.  Since  the  present  study 
considers  only  a  change  in  the  boundary  value  T( 0), 
which  is  a  parameter,  we  are  studying  only  a  very 
special  case  of  sensitivity  to  boundary  conditions, 
and  this  special  case  is  equivalent  to  sensitivity  to 
parameters. 

2)  Two  kinds  of  predictability  problems  exist  in  the 
Lorenz  system,  namely,  the  model  sensitivity  to  ini¬ 
tial  (first  kind)  and  boundary  (second  kind)  pertur¬ 
bations.  The  effect  of  the  boundary  error  on  the  mod¬ 
el  can  be  represented  as  a  forcing  term. 

3)  Introducing  the  same  small  relative  error  (10  4 )  to 
either  the  initial  or  boundary  condition,  the  Lorenz 
system  has  a  growing  period  and  an  oscillation  pe¬ 
riod.  During  the  growing  period,  the  model  error 
increases  from  0  to  an  evident  value  larger  than  1. 
During  the  oscillation  period,  the  model  error  oscil¬ 
lates  between  two  evident  values. 

4)  For  the  wide  range  of  the  parameter  space,  both  the 
error-growing  period  and  the  relative  error  are  com- 


Fig.  5.  Time  evolution  of  relative  error  with  varying  wavenumber 
parameter  b:  (a)  E{I)(r,  b )  and  (b)  E(B)(t,  b). 


1432 


JOURNAL  OF  THE  ATMOSPHERIC  SCIENCES 


Volume  56 


parable  between  the  first  kind  of  problem  (initial 
inaccuracy)  and  second  kind  of  problem  (boundary 
inaccuracy).  This  suggests  the  importance  of  pre¬ 
paring  accurate  boundary  conditions  for  numerical 
prediction. 

Acknowledgments.  The  author  is  grateful  to  Dr.  Mar¬ 
tin  Claussen  and  two  anonymous  reviewers  whose  com¬ 
ments  improved  the  manuscript  a  great  deal.  Many 
thanks  to  Chenwu  Fan  and  Shihua  Lu  for  programming 
assistance.  This  work  was  funded  by  the  Naval  Ocean¬ 


ographic  Office,  the  Office  of  Naval  Research  Naval 
Ocean  Modeling  and  Prediction  Program,  and  the  Naval 
Postgraduate  School. 

REFERENCES 

Chu,  P.  C.,  S.  H.  Lu,  and  Y.  C.  Chen,  1998:  Second  kind  predictability 
in  climate  models.  Preprints,  Ninth  Symp.  on  Global  Change 
Studies,  Phoenix,  AZ,  Amer.  Meteor.  Soc.,  86-90. 

Lorenz,  E.  N.,  1963:  Deterministic  nonperiodic  flow.  J.  Atmos.  Sci., 
20,  130-141. 

Saltzman,  B.,  1962:  Finite  amplitude  free  convection  as  an  initial 
value  problem — I.  J.  Atmos.  Sci.,  19,  329-341. 


